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A search engine for retrieving documents 
pertinent to a query indexes documents in ac- 
cordance with hyperlinks pointing to those docu- 
ments. The indexer traverses the hypertext data- 
base and finds hypertext information including the 
address of the document the hyperlinks point to 
and the anchor text of each hyperlink. The infor- 
mation is stored in an inverted index file, which 
may also be used to calculate document link vec- 
tors for each hyperlink pointing to a particular 
document. When a query is entered, the search 
engine finds all document vectors for documents 
having the query terms in their anchor text. A 
query vector is also calculated, and the dot prod- 
uct of the query vector and each document link 
vector is calculated. The dot products relating to 
a particular document are summed to determine 
the ■ 
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HYPERTEXT DOPI fM FNT RETRTF.VAI. SYSTEM AND MFTHAn 

FIELD OF INVENTION 

The present invention relates to hypertext document retrieval, 
and more particularly to systems and methods of searching databases 
5 distributed over wide-area networks such as the World Wide Web. 

BACKGROUND OF THE ART 

A hypertext is a database system which provides a unique 
and non-sequential method of accessing information using nodes and links. 
Nodes, i.e. documents or files, contain text, graphics, audio, video, 
10 animation, images, etc. while links connect the nodes or documents to 
other nodes or documents. The most popular hypertext or hypermedia 
system is the World Wide Web, which links various nodes or documents 
together using hyperlinks, thereby allowing the non-linear organization of 
text on the web. 

15 A hyperlink is a relationship between two anchors, called the 

head and the tail of the hyperlink. The head anchor is the destination node 
or document and the taii anchor is the document or node from which the 
link begins. On the web, hyperlinks are generally identified by 
underscoring or highlighting certain text or graphics in a tail anchor 
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Search engines usually take a user query as input and attempt 
to find documents related to that query. Queries are usually in the form of 
several words which describe the subject matter of interest to the user. 
Most search engines operate by comparing the query to an index of a 
5 document collection in order to determine if the content of one or more of 
those documents matches the query. Since most casual users of search 
engines do not want to type in long, specific queries and tend to search on 
popular topics, there may be thousands of documents that are at least 
tangentially related to the query. When a search engine has indexed a large 
10 document collection, such as the Web, it is particularly likely that a very 
large number of documents will be found that have some relevance to the 
query. Most search engines, therefore, output a list of documents to the 
user where the documents are ranked by their degree of pertinence to the 
query and/or where documents having a relatively low pertinence are not 
15 identified to the user. Thus, the way in which a search engine determines 
the relevance ranking is extremely important in order to limit the number 
of documents a user must review to satisfy that user's information needs. 

Almost all ranking techniques of search engines depend on 
the frequency of query terms in a given document. When other related 
20 factors are the same, the higher a term's frequency in a given document 
the higher the relevance score of this document to a query including that 
term. Factors other than term frequency, such as such document 
frequency, i.e. how many documents contain the term, may also be taken 
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Using an inverse document frequency insures that junk words such as 
"the," "of." "as," etc. do not have a high weight. In addition, when a 
query uses multiple terms, and one of those terms appears in many 
documents, using an IDF weighting gives a lower ranking to documents 
5 containing that term, and a higher ranking to document containing other 
terms in the query. 

There are normalized versions of term weighting, which take 
into account the length of a document including a particular term. The 
assumption made is that the more frequently a term appears in a document 
10 for a given amount of text, the more likely that document is relevant to a 
query including that term. Thai assumption may not be true, however, in 
many cases. For example, if the query is "Java tutorial," a document (call 
it J), which contains 100 lines with each line consisting of just the phrase 
"Java tutorial," would get a very high relevance score and would be output 
15 by a search engine as one of the most relevant documents to the user. That 
document, however, would be useless to the user since it provides no 
information about a "Java tutorial." What the user really needs is a good 
tutorial for the Java programming language such as found on Sun's Java 
tutorial site (http://Java.sun.com/tutorial). Unfortunately, the phrase "Java 
20 tutorial" does not occur 100 times on Sun's site, and therefore most search 



WO 97/49048 



PCT/US97/I0191 



- 7 - 

which are in a language other than the language of the query entered by the 
search engine user. Translation tools are a possible solution, but they may 
be difficult and expensive to build. 

In addition, traditional search engines may be unable to 
identify non-textual material which is relevant to a query. For instance, a 
Web site containing pictures of Mozart or examples of Mozart's music may 
not be deemed relevant by a search engine when that search engine can 
only search for the word "Mozart" within the text of documents. 

SUMMARY OF THE TMVFNTtON 

A method of indexing documents includes obtaining a list of 
hyperlinks pointing to each document, where each hyperlink includes one 
or more terms. Each document is indexed with the terms in the hyperlink 
pointing to that document. A number of hyperlinks, each containing a 
particular term, may point to a document. The number of hyperlinks 
containing that particular term pointing to the document is indexed with 



A particular term may appear in hyperlinks pointing to a 
number of documents, and the number of documents having the particular 
term in hyperlinks pointing to those documents is indexed with that term. 
Indexing may include creating a file listing each term, the number of 
documents having that term in hyperlinks pointing to those documents, a 
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for each hyperlink pointing to a particular document to obtain a summed 
relevance score for that document. 

The query may be represented by a query vector where the 
query vector contains a dimension for each term in the query. Each 
5 document may be represented by document link vectors for each hyperlink 
pointing to the document, where each document link vector contains a 
dimension for each term in the corresponding hyperlink pointing to that 
document. Comparing the words in the query to the words in the 
hyperlinks includes calculating the dot product of the query vector with the 
10 document link vector for that hyperlink. Summing the relevance ranking 
for each hyperlink pointing to a document includes summing the dot 
products obtained using the document link vectors for a particular 
document to obtain the summed relevance score for that document. The 
summed relevance scores may then be compared to obtain a ranking of 
15 documents. 

The dimension for a term in a query vector may be related to 
the inverse of the number of documents having a respective hyperlink 
containing that term pointing to those documents. Similarly, the dimension 
for a term in a document link vector may be related to the inverse of a 
20 number of documents having a respective hyperlink containing that term 
pointing to those documents. 

Other features and advantages are inherent in the hypertext 
document retrieval system and method claimed and disclosed or will 
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service provider or through any one or more of the other servers. Servers 
13, 14, 15, and 16 include files of documents 17, 18, 19, and 20, 
respectively. Files 17, 18, 19, and 20 contain documents available to users 
of the network. Server 12 includes an index file 21 as discussed in more 
5 detail below. The server computer 12 traverses the network looking for all 
hypertext documents residing in the files 17-20 of the other server 
computers 13-16 in order to build the index file 21. 

Fig. 2 describes the general structure of an indexing and 
retrieval system 30 of the present invention. A user from outside the 
10 system 30 inputs a query 32 through a user interface 34, which will 

typically reside on the user's computer, such as a client computer 10 (Fig. 
1). The user's query is then transmitted through the network to the 
indexing and retrieval system 30, which generally resides on a server, such 
as server 12 (Fig. 1). The system 30 includes a retrieval engine 36, index 
15 files 38. and an index engine 40. The operation of the retrieval engine 36 
and index engine 40 and the creation of the index files 38 are described 
below. The index engine 40 creates the index files 38 by traversing a 
document database 42, such as that found on the World Wide Web. The 
document database 42 might include files 17-20 (Fig. 1). The index files 
20 38 created by the index engine 40 may take various forms in accordance 
with the present invention, but may include a link file 44. an inverted file 
46, and a document vector file 48, all of which are described in detail 
below. The retrieval engine 36 uses the index files 38 in order to 
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identifies the anchor text of the hyperlink 50. By identifying the phrase 
"good tutorial on Java" as the anchor text in the command 66, that phrase 
is thereby underlined in the text 56 of Document A. When text such as 
anchor text 64 is underlined, it alerts a reader of Document A to the 
5 existence of the hyperlink. When a user then clicks on the anchor text 64, 
the command 66 points to Document B. thereby instructing the user's 
computer to send a message to the address URL2, requesting a copy of 
Document B. 

The author of Document A must, of course, create the 
10 command 66 and identify the anchor text 64. Generally, authors of such 
documents will describe, in that author's opinion, the head anchor 
document (in this case Document B) with the words of the anchor text (in 
this case, anchor text 64). Therefore, if there are many authors like the 
author of Document A that make link commands to document B using the 
15 anchor text 64, then a user looking for a Java tutorial is highly likely to be 
interested in the information in Document B. 

Fig. 4 is a representation of a simple hypertext system 
having only four documents. Documents A, B, C, and D. The system 
shown in Fig. 4 has only three hyperlinks, hyperlink 50, also shown in 
10 Fi 8- 3 < and hyperlinks 68 and 70. The anchor text "good tutorial on Java" 
in Document A is the tail for the hyperlink from Document A to Document 
B, as shown in Fig. 3. Document C contains two sets of anchor text "Java 
tutorial" and "Sun's Java site." The anchor text 72 in Document C points 
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system may also collect a variety of information about the document 
including its title and possibly the text of the document. The system may 
also create an abstract, if desired. 

At block 104, the system creates one or more link files 
5 where entries in the files have a format: 

< doc.ID, anchor-text > 
where doc.ID is an identifier for each head document of a hyperlink having 
the corresponding anchor text. The doc.ID may be in the form of a URL 
or may be another identifier which is indexed in some manner with the 
10 document s URL. Box 104A is an example of a link file, as referred to in 
Fig. 2, created for the database of the documents shown in Fig. 4. Since 
the database in Fig. 4 has three hyperlinks, there are three entries in file 
104A. The system may also store the number of times a term appears in 
anchor text for a particular link. In the examples shown, each term only 
15 appears once in a panicular link. 

Although Fig. 5 shows that traversing of documents in block 
100 occurs before link files are created at block 104, it is possible for some 
link files to be created prior finishing traversing all documents in the 
database. In fact, once the database has been entirely traversed, it may be 
20 desirable to update the link files and other index files by retraversing 
documents in order to determine if any additional documents have been 
added to the database, or if any hyperlinks have been added to the 
documents. 
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Control next passes to block 112. which creates final invert 
file as shown in 112A. Entries in the final invert file are in the format: 

< term, DF, doci, lfl, doc2, lf2 doci, LFi > 

where "term" is a term in the anchor text, DF is the document frequency 
for that term, doci is the document identifier for Document i, and LFi is 
the link term frequency for doci. Link term frequency is defined as the 
number of hyperlinks pointing to doci whose anchor text consists of the 
particular term. For example, the term "good" appears in only one 
hyperlink that points to Document B. so the link term frequency of the 
term "good" for Document B is one. The term "Java" appears in two 
hyperlinks that point to Document B, so the link term frequency of "Java" 
for Document B is two. One embodiment of the retrieval engine of the 
present invention will depend on this file to find documents related to a 
user query. 

The index engine at box 114 may also generate a document 
link vector file where entries in the document link vector file are in the 
format of: 

doc. id, v,, v 2 , Vi 
where doc. id is the identifier for a particular document, and V| is a vector 
representation of a hyperlink found in the link file. Each vector v, will be 
in the format of: 

< w(t,), MW w(ti) > 
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Thus, the only entries in the link vector files which need to be created are 
those pertaining to documents having query terms in the anchor text of 
hyperlinks pointing to those documents. 

In the first vector for Document B, the first three dimensions 
are "one" since the terms "good," "tutorial," and "on" only appear in 
anchor text pointing to one document, and they only appear once in the 
anchor text. Thus: 

TF*IDF = 1*1 = 1. 
The term "Java," however, has a term frequency of one and document 
frequency of two, and therefore has an inverse document frequency of .5. 
Thus, TF*IDF for "Java" is .5, making the last dimension in the first 
vector for Document B equal to .5. The remaining dimensions in the 
second vector for Document B and the vector for Document D are also 
calculated according to the TF*IDF formula. 

The link file I04A, the invert file 108A, the final invert file 
112A. and the document link vector file 114 are all considered index files 
as shown in Fig. 2. Although the files as shown in Fig. 5 are preferred, 
there are many indexing techniques which can be used with a system of the 
present invention, which rely on anchor text and link frequency in order to 
index documents. For instance, the files may be compressed or have a 
variety of relational structures for the data within files or between files. 

Referring now to Fig. 6, the retrieval process achieves 
relevance ranking by using the vector space model and link vector voting. 
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"tutorial" in the query. The IDF as previously calculated in box 110 of 
Fig. 5 for "Java" is .5 and as calculated for "tutorial" is one. 

Once the query vector and all relevant document link vectors 
have been found or calculated, control passes to block 130 to calculate the 
relevance scores for each document. The relevance score is calculated by 
finding the dot product of each document link vector with the query vector. 
A dot product for vectors < a, b, c > and < d, e, f > j s defined as: 
a*d + b*e + c*f 



If two vectors do not have the same dimensions, a zero is 
entered for each dimension which is not present in that vector. For 
instance, the first vector for Document B is represented as: 

< 1. 1, 1, 0.5 >. 
In such an instance, the query vector would be represented as: 
< 0, 1, 0, .5 > 

so that the dimensions representing ••tutorial" in each vector and "Java" in 
each vector match up. The dot product of the query vector with the first 
document link vector for Document B would then be calculated as follows: 

Oxl + lxl + Ox 1 + .5 x .5 

— ~ - 620 

^+l 2 +l s + .5Vl 2 +.5 2 

A similar calculation for the second vector for Document B would lead to a 
dot product of 1 . 
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combination with the hyperlinked based index and retrieval system of the 
present invention. This combination might be used in the case of a 
link-based relevance score tie, or merely to supplement the link-based 
information. For instance, suppose the relevance scores for Document A 
5 and C are 0.6 and 0.8, respectively, based on conventional and relevance 
ranking. The final relevance ranking for the query utilizing the 
conventional ranking to break the tie of the link-based ranking would be 
Document B, Document D, Document C, and Document A. 

Another reason to use combination ranking may be when 
10 there are too few hyperlinks (such as only one link) pointing to a 

document. In such a case, the relevance score based upon the one link 
may not be accurate, so a threshold can be set for the link-based relevance 
score. If the link-based relevance score is lower than the threshold, other 
means of relevance ranking may be used or combined with the link-based 
15 relevance score. 

Because the index files of the present invention use only 
hyperlink information, relevance ranking does not depend on the words 
appearing in documents themselves, or, if used in combination with 
conventional relevance ranking do not depend solely on words appearing in 
20 the documents Instead, the relevance ranking depends on descriptions of 
those documents in the anchor text of hyperlinks pointing to the documents. 
Documents such as Document J described above will not have a high 
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describes itself. Thus, in the examples shown above. Sun's Java tutorial 
site will receive a high summed relevance rank even though the term "Java 
tutorial" appears only once in the document. 

The ranking method based on hyperlinks pointing to a given 
document can be used to select the most popular documents in a specific 
field using the feature words or description of that field as the query to the 
system. By analyzing the link file described in the preferred embodiment, 
and comparing the different descriptions of hyperlinks pointing to the same 
document, a system can automatically construct a thesaurus or synonym 



10 tool. 



The foregoing detailed description has been given for 
clearness of understanding only, and no unnecessary limitations should be 
understood therefrom, as modifications would be obvious to those skilled in 
the art. 



WO 97/49048 



FCT/US97/10I91 



- 27 - 

3. The method of claim 2 wherein the indexing 
2 comprises creating a file listing: 
each term; 

4 the number of documents having that term in hyperlinks 

pointing to those documents; 
6 a document identifier for each document having that term ii 

hyperlinks pointing to that document; and 

the number of hyperlinks containing that term pointing to 

each identified document. 



4, The method of claim 1 wherein: 
a particular term may appear in hyperlinks pointing to a 

number of documents; and 

the number of documents having the particular term in 

hyperlinks pointing to those documents is indexed with a document 

identifier for each document having the particular term in a hyperlink 

pointing to that document. 



5. The method of claim 4 wherein each document having 
2 a particular term in a hyperlink pointing to that document is indexed with 

an inverse of the number of documents having the particular term in 
4 hyperlinks pointing to those documents. 
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10. A method of ranking documents based on the 
2 document's relevance to a query, wherein the query comprises at least one 

term, and wherein hyperlinks contain terms and point to corresponding 
4 documents, the method comprising: 

comparing the words in the query to the words in a 
6 hyperlink to obtain a relevance ranking for each hyperlink; and 

summing the relevance rankings for each hyperlink pointing 
8 to a particular document to obtain a summed relevance score for that 
document. 



11. The method of claim 1 0 wherein : 

2 a number of hyperlinks, each containing a particular term, 

may point to a document; and 
4 the number of hyperlinks containing the particular term 

pointing to the document is indexed with that document. 

12. The method of claim 1 1 wherein: 

2 a particular term may appear in hyperlinks pointing to a 

number of documents; and 
4 the number of documents having a particular term in 

hyperlinks pointing to those documents is indexed with that term. 



WO 97/49048 



PCT/US97/I0191 



- 31 - 

16. The method of claim 10 wherein: 

2 a term may appear a number of times in a hyperlink pointing 

to a document; and 
4 the number of times each term appears in a hyperlink is 

indexed with the document pointed to by the hyperlink. 

17. The method of claim 10 wherein the terms are 
2 stemmed words. 

18. The method of claim 10 wherein: 

2 the query is represented by a query vector wherein the query 

vector contains a dimension for each term in the query; and 

4 each document is represented by document link vectors for 

each hyperlink pointing to the document, wherein each document link 

6 vector contains a dimension for each term in the corresponding hyperlink 
pointing to that document. 

19. The method of claim 18 wherein comparing the words 
2 in the query to the words in the hyperlink comprises calculating the dot 

product of the query vector with the document link vector for that 
4 hyperlink. 
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25. A computer-readable memory device comprising a set 
of instructions for performing the method of claim 1. 
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